Towards a Common Framework for Multimodal Generation: The Behavior Markup Language
نویسندگان
چکیده
This paper describes an international effort to unify a multimodal behavior generation framework for Embodied Conversational Agents (ECAs). We propose a three stage model we call SAIBA where the stages represent intent planning, behavior planning and behavior realization. A Function Markup Language (FML), describing intent without referring to physical behavior, mediates between the first two stages and a Behavior Markup Language (BML) describing desired physical realization, mediates between the last two stages. In this paper we will focus on BML. The hope is that this abstraction and modularization will help ECA researchers pool their resources to build more sophisticated virtual humans.
منابع مشابه
Representing Communicative Function and Behavior in Multimodal Communication
In this paper I discuss how communicative behavior can be represented at two levels of abstraction, namely the higher level of communicative intent or function, which does not make any claims about the surface form of the behavior, and the lower level of physical behavior description, which in essence instantiates intent as a particular multimodal realization. I briefly outline the proposed SAI...
متن کاملRealActor: Character Animation and Multimodal Behavior Realization System
In this paper we present RealActor, a character behavior realization system for embodied conversational agents based on the Behavior Markup Language (BML). Developed several years ago as part of the SAIBA framework, BML is an XML dialect for describing physical realizations of multimodal human behaviors. It allows modeling of complex communicative utterances which include both verbal and non-ve...
متن کاملMPML3D: A Reactive Framework for the Multimodal Presentation Markup Language
MPML3D is our first candidate of the next generation of authoring languages aimed at supporting digital content creators in providing highly appealing and highly interactive content with little effort. The language is based on our previously developed family of Multimodal Presentation Markup Languages (MPML) that broadly followed the “sequential” and “parallel” tagging structure scheme for gene...
متن کاملRepresenting Communicative Functions in SAIBA with a Unified Function Markup Language
The SAIBA framework proposes two interface languages to represent separately an intelligent agent’s communicative functions (or intents) and the multimodal behavior determining how the functions are accomplished with a particular multimodal realization. For the functional level, the Function Markup Language (FML) has been proposed. In this paper we summarize the current status of FML as discuss...
متن کاملPerception Markup Language: Towards a Standardized Representation of Perceived Nonverbal Behaviors
Modern virtual agents require knowledge about their environment, the interaction itself, and their interlocutors’ behavior in order to be able to show appropriate nonverbal behavior as well as to adapt dialog policies accordingly. Recent achievements in the area of automatic behavior recognition and understanding can provide information about the interactants’ multimodal nonverbal behavior and ...
متن کامل